System and method to measure, analyze, and model pulmonary function and disease utilizing temporal, spatial, and contextual data

ABSTRACT

An information processing system, computer readable storage medium, and methods for analyzing the airflow related health of a person. A method includes obtaining an audio sample of a person&#39;s verbal communication, obtaining geographic information of the person, querying a remote server based on the geographic information, and obtaining additional information from the remote server, the additional information being related to the geographic information, and extracting contours of amplitude change from the at least one audio sample over a period of time, the contours of amplitude change corresponding to changes in an airflow profile of the person. The method further includes correlating the contours of amplitude change with periodic episodes typical of airflow related health problems, and determining, based at least on the additional information, whether the contours of amplitude change result from at least one local environmental factor related to the geographic information.

BACKGROUND

The present disclosure generally relates to measurement and analysis oftemporal, spatial, and contextual effects on lung function ofindividuals, and more particularly relates to a method and system formeasuring changes in characteristics of an individual's speech and vocaltract related air flow and from those measurements, along with otherrelated temporal, spatial, and contextual information, determining thepresence of triggers for airflow related disease, and informingindividuals regarding such triggers.

Pulmonary health and capacity can be seriously impacted by various typesof pulmonary disease and by external disease triggers such as, but notlimited to, pollen count, smog, and various types of air pollution.

The most common symptoms of asthma include shortness of breath,wheezing, chest tightness and a dry, irritating, continual cough, allcaused at least in part by narrowing of the airway. Chronic obstructivepulmonary disease, involves a gradual progression from inflation to thesmall airways that limits airflow to the destruction of alveolar wallsand capillaries which leads to loss of elasticity. Symptoms of emphysematherefore include a distinctive cough and shortness of breath.

Triggers for acute disease can have drastic immediate effects onindividuals Likewise triggers that affect chronic disease on a day today basis can have a substantial effect on an individual. Knowledge ofwhat and where these triggers are and how to avoid or mitigate them canbe very powerful information for afflicted individuals.

BRIEF SUMMARY

According to one embodiment of the present disclosure, a method foranalyzing the airflow related health of a person, the method comprising:obtaining at least one audio sample of a person's verbal communication;obtaining geographic information of the person, the geographicinformation being associated with the at least one audio sample of theperson's verbal communication; querying at least one additional sourceof information based on the geographic information, and as a result ofthe querying obtaining additional information from the at least oneadditional source of information, the additional information beingrelated to the geographic information; extracting contours of amplitudechange from the at least one audio sample over a period of time, thecontours of amplitude change corresponding to changes in an airflowprofile of the person; correlating the contours of amplitude change withperiodic episodes typical of airflow related health problems; anddetermining, based at least on the additional information, whether thecontours of amplitude change result from at least one localenvironmental factor related to the geographic information.

According to another embodiment of the present disclosure, aninformation processing system is capable of analyzing the airflowrelated health of a person. The information processing system comprises:a microphone circuit for receiving audio signals from an ambientenvironment in vicinity of the information processing system, andconverting the audio signals to electronic audio signals;analog-to-digital conversion circuits, coupled with the microphonecircuit, for converting the electronic audio signals to digitized audiosignals; memory; non-volatile memory for storing data and computerinstructions; a pulmonary health monitor, communicatively coupled withthe non-volatile memory; a user pulmonary health current profile,communicatively coupled with the non-volatile memory; a user's speechcharacteristics model, communicatively coupled with the non-volatilememory; a contextual information database, communicatively coupled withthe non-volatile memory; a processor, communicatively coupled with theanalog-to-digital conversion circuits, the memory, the non-volatilememory, and the pulmonary health monitor, and wherein the processor,responsive to executing computer instructions, performs operationscomprising: obtaining at least one audio sample of a person's verbalcommunication, captured from the ambient environment in vicinity of theinformation processing system; obtaining geographic information of theperson, the geographic information being associated with the at leastone audio sample of the person's verbal communication; querying at leastthe contextual information database based on the geographic information,and as a result of the querying obtaining additional information fromthe contextual information database, the additional information beingrelated to the geographic information; extracting contours of amplitudechange from the at least one audio sample over a period of time, thecontours of amplitude change corresponding to changes in an airflowprofile of the person, the airflow profile of the person being stored inat least one of the user's speech characteristics model and the userpulmonary health current profile; correlating the contours of amplitudechange with periodic episodes typical of airflow related healthproblems; and determining, based at least on the additional information,whether the contours of amplitude change result from at least one localenvironmental factor related to the geographic information.

According yet to another embodiment of the present disclosure, acomputer readable storage medium comprises computer instructions which,responsive to being executed by a processor, cause the processor toperform operations comprising: obtaining at least one audio sample of aperson's verbal communication; obtaining geographic information of theperson, the geographic information being associated with the at leastone audio sample of the person's verbal communication; querying at leastone additional source of information based on the geographicinformation, and as a result of the querying obtaining additionalinformation from the at least one additional source of information, theadditional information being related to the geographic information; fromthe at least one audio sample, extracting contours of amplitude changeover a period of time that can be mapped to changes in an airflowprofile of the person; correlating the contours of amplitude change withperiodic episodes typical of airflow related health problems; anddetermining, based at least on the additional information, whether thecontours of amplitude change result from at least one localenvironmental factor related to the geographic information.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

The accompanying figures, in which like reference numerals refer toidentical or functionally similar elements throughout the separateviews, and which together with the detailed description below areincorporated in and form part of the specification, serve to furtherillustrate various embodiments and to explain various principles andadvantages all in accordance with the present disclosure, in which:

FIG. 1 is a block diagram illustrating an example of a communicationsystem in which an information processing system can operate accordingto methods of the present disclosure;

FIG. 2 is a block diagram illustrating an example of an informationprocessing system according to various embodiments of the presentdisclosure;

FIG. 3 is a block diagram illustrating an example of a user pulmonaryhealth tracking database as shown in FIG. 1, according to variousexamples of the present disclosure;

FIG. 4 is a block diagram illustrating an example of a user pulmonaryhealth current profile database as shown in FIG. 2, according to variousexamples of the present disclosure;

FIG. 5 is a block diagram illustrating an example of a user pulmonaryhealth history database as shown in FIG. 2, according to variousexamples of the present disclosure;

FIG. 6 is a block diagram illustrating an example of a user's speechcharacteristics model as shown in FIG. 2, according to various examplesof the present disclosure; and

FIG. 7 is a functional block diagram illustrating an example ofoperations and data flowing used in an information processing systemsuch as shown in FIG. 2, according to various examples of the presentdisclosure.

DETAILED DESCRIPTION

According to various embodiments of the present disclosure, disclosed isa system and method to measure and analyze temporal, spatial, andcontextual affects on lung function of a person. Proposed is aninformation processing system to measure the temporal changes in speechcharacteristics of a user, inferring lung function from thosemeasurements, and performing temporal and spatial analysis on this data.Specifically, according to one embodiment, a smart mobile deviceequipped with microphones and location services can be used to detectand analyze the volume, tempo, intonation, emphasis, sentence and wordlength, and other speech characteristics produced by the mobile deviceuser. The smart mobile device, according to certain embodiments, cancorrelate these characteristics to detect changes in characteristicsthat infer acute symptoms of pulmonary diseases, as well as that canindicate the progression of chronic pulmonary disease. Changes incharacteristics can be mapped, temporally and spatially, with referenceto context information to detect triggers of the changes. The smartmobile device can detect changes in airflow through detection of changesin the characteristics of a mobile device user's speech. The smartmobile device uses the detected information to inform a person, such asthe user of the smart mobile device, concerning pulmonary disease of theperson using the smart mobile device, and how that disease is affectedby weather, geography, and other contextual data such as a level ofairborne particulate matter concentration (e.g., pollen, smog, andpollutants) in a geographic region.

According to various embodiments, the smart mobile device generatesand/or updates a model of the characteristics of the user's speech. Thesmart mobile device uses the model to determine how thesecharacteristics, and changes thereto, relate to pulmonary health andairflow capacity of a person using the smart mobile device, and howthese characteristics relate to the other contextual data sources, suchas geographic data, weather, presence of particulates in the atmosphere,and other likely pulmonary disease triggers.

The most common symptoms of asthma include shortness of breath,wheezing, chest tightness and a dry, irritating, continual cough, allcaused at least in part by narrowing of the airway. Chronic obstructivepulmonary disease, involves a gradual progression from inflation to thesmall airways that limits airflow to the destruction of alveolar wallsand capillaries which leads to loss of elasticity. Symptoms of emphysematherefore include a distinctive cough and shortness of breath.

Triggers for acute disease can have drastic effects on individuals,knowledge of what and where these triggers are and how to avoid ormitigate them can be very powerful.

Likewise, factors that affect chronic disease on a day to day basis canhave a substantial effect on an individual's pulmonary health and wellbeing. Proposed is a system that helps empower users as decision makersin the management of their pulmonary disease and health, using a widearray of information sources including physiological, geographical,historical, and contextual data that can be queried from sources ofinformation.

Various embodiments of the present disclosure monitor the trend of ausers' speech such as word use and sentence structure to derive a peakairflow value of a user and model this value over time in conjunctionwith environmental data including the weather, particulate data,location data etc, to build a model of a user including their pulmonaryfunction. This model is used to derive potential contextual triggerevents to acute declines in the user's pulmonary function and to providefeedback to the user and/or their health care provider.

Referring to FIG. 1, an example communication system 100 is shown,according to various embodiments of the present disclosure. A pulmonaryhealth monitor server 102 is communicatively coupled with a userpulmonary health tracking database 104. The pulmonary health monitorserver 102 is communicatively coupled with a wide area network N2 106.The wide area network N2 106, in this example, can comprise one or morenetworks (e.g., any combination of local area network(s) and wide areanetworks) distributed over a wide geographic area.

A laptop PC 108, according to the present example, is communicativelycoupled with the wide area network N2 106. In the example, the laptop PC108 is communicatively coupled with the wide area network N2 106 via awired communication interface. However, other types of communicationinterfaces are equally applicable for facilitating communication betweenthe laptop PC 108 and the wide area network N2 106. The laptop PC 108comprises wireless communication circuits and at least one antenna 109that facilitate the laptop PC 108 communicating with at least onewireless communication network N1 112, as shown.

In the present example, a mobile phone 110 is communicatively coupledwith the wireless communication network N1 112. The mobile phone 110includes at least one antenna 111 that facilitates wirelesscommunication with the wireless communication network N1 112. The mobilephone 110 is able to make telephone calls and receive telephone callsover the wireless communication network N1 112. Additionally, the mobilephone 110 can wirelessly transmit and receive messages over the wirelesscommunication network N1 112 to other information processing systems anddevices.

Each of the laptop PC 108 and the mobile phone 110 respectively includesa microphone 120, 126, a user pulmonary health profile database 118,124, and a pulmonary health monitor 116,122, as shown in the example ofFIG. 1. These elements of the laptop PC 108 and the mobile phone 110will be discussed in more detail below.

The wireless communication network N1 112 is managed through a networkoperating center (NOC) 114 that controls and coordinates communicationswith information processing systems and wireless devices that are usingthe wireless communication network N1 112. The NOC 114 also provides anetwork communication interface between the at least one wirelesscommunication network N1 112 and the wide area network 106, as shown.For example, according to various embodiments, the laptop PC 108 and themobile phone 110 can wirelessly transmit and receive messages over thewireless communication network N1 112, and via the NOC 114 over the widearea network N2 106, to-from other remotely located informationprocessing systems and devices.

A weather and particulate data server 128, according to the presentexample, is communicatively coupled with a corresponding weather andparticulate database 130. The weather and particulate server 128 iscommunicatively coupled with the wide area network N2 106 as shown. Theweather and particulate server 128, operating in communication with thecorresponding weather and particulate database 130, provides contextualdata in response messages that are sent in response to request messagesreceived from information processing systems and devices that may belocated remotely across the wide area network N2 106, as will bediscussed in more detail below.

An information processing system 200 is shown in FIG. 2 according to oneexample. The information processing system 200 may comprise, accordingto various embodiments of the present disclosure, at least one of aninformation processing system, a mobile phone, a personal computer, alaptop PC, a tablet PC, and other types of information processingsystems and devices, as will be discussed below.

The information processing system 200 includes at least one processor202. The at least one processor 202 is communicatively coupled with mainmemory 204 and with non-volatile memory 206. An input-output interface208 is communicatively coupled with the processor 202 and provides aninterface with external networks 234 as shown. The external networks234, according to various embodiments, may include the wide area networkN2 106 and the at least one wireless communication network N1 112. Theinput-output interface 208 can also be communicatively coupled with amedia reader-writer 230. The media reader-writer 230 can becommunicatively coupled with a computer-readable storage medium 232allowing the processor 202 to read data and computer instructions from,and optionally write data and computer instructions to, thecomputer-readable storage medium 232.

The non-volatile storage 206 can store data, configuration parameters,and computer instructions, that are useable by the processor 202. Apulmonary health monitor 218 is stored in the non-volatile storage 206.The pulmonary health monitor 218 can interoperate with the processor 202to provide novel functions and features of the information processingsystem 200, according to various embodiments of the present disclosure.

A user pulmonary health profile database 220 is stored in thenon-volatile storage 206 and communicatively coupled with the processor202. The user pulmonary health profile database 220 comprises current(i.e., short term) pulmonary health profile data associated with one ormore persons that are users of the information processing system 200.For example, and not for limitation, user pulmonary health profile datamay be maintained for each user for the past several minutes, hours,today, or possibly the last few days, such that it represents a currentprofile of the user's pulmonary health.

A user pulmonary health history database 222 is stored in thenon-volatile storage 206 and communicatively coupled with the processor202. The user pulmonary health history database 222 includes userpulmonary health data that is tracked for each person that is a user ofthe information processing system 200 over an extended period of time(i.e., long term). For example, and not for limitation, user pulmonaryhealth history may be maintained and tracked for one or more users forthe past several days, weeks, months, or over the life of the user's useof the information processing system 200. Each user is tracked withtheir own pulmonary health history database 222.

A user's speech characteristics model 224 is stored in the non-volatilestorage 206 (and accordingly is communicatively coupled with theprocessor 202) for each person who is a user of the particularinformation processing system 200. The user's speech characteristicsmodel 224 provides information related to a particular person's speechcharacteristics which can be used, along with temporal, spatial, andcontextual information that can affect lung function and airflow diseaseof a person. For example, a user's speech characteristics can includethe particular person's voiced and non-voiced speech audio volume,tempo, intonation, emphasis, sentence and word length, and other speechcharacteristics produced by the person who is a user of the particularinformation processing system 200.

It should be noted that a user's speech characteristics could varybetween the person's use of different information processing systems200. For example, a person that uses the mobile phone 110 and also usesthe laptop PC 108 at different times to communicate their speech audio,may have stored in each of the mobile phone 110 and the laptop PC 108two different user's speech characteristics models 224 for the sameperson. This variation in the two models 224 can be caused, for example,by the different audio input interface and speech processing circuitryin the mobile phone 110 as compared with the laptop PC 108. Also, theperson's mouth location relative to a microphone and the person'sposture during speaking can significantly vary between the person's useof the mobile phone 110 as compared with their use of the laptop PC 108.Additionally, the environment in which a user normally uses the mobilephone 110 can vary from the environment in which the user uses thelaptop PC 108. For example, the laptop PC 108 may be normally used whileindoors, while the mobile phone 110 may be used more on-the-go whileoutdoors. There are many factors that can affect the user's speechcharacteristics while using a particular information processing system200. Accordingly, multiple user's speech characteristics models 224could be dynamically maintained for the same user that uses multipleinformation processing systems 200, one model 224 associated with eachsystem 200.

A contextual information database 226 is stored in the non-volatilestorage 206. The contextual information database 226 maintains varioustypes of contextual information, such as, but not limited to, geographicdata, weather information, prevalence of airborne particulate matter,pollen count, and likely airflow disease triggers, and also suchcontextual data as the level of background noise experienced in aparticular geographic location, the amount of speech-related activities(e.g., number of phone calls, meetings, etc.) the person made duringcertain times at a particular geographic location. The processor 202 canquery the contextual information database 226 based on the geographicinformation of the person using the mobile phone 110, and as a result ofthe querying can obtaining additional information from the contextualinformation database. Contextual information can be analyzed incombination with the person's speech characteristics, to analyze anaudio sample obtained from a person's verbal communication fordetermining a user's pulmonary health and airflow disease and likely(e.g., determined likely from past monitored experiences and predictedinformation for particular tracked geographic information) presence oftriggers of airflow disease, as will be discussed in more detail below.

With continued reference to FIG. 2, the information processing system200 includes a wireless transceiver 210 communicatively coupled with theprocessor 202, which facilitates the processor 202 communicating overone or more wireless communication networks such as the wirelesscommunication network N1 112 shown in FIG. 1. The wireless transceiver210 can support short-range or long-range wireless access technologiessuch as Bluetooth, Zigbee, Wi-Fi, Digital Enhanced CordlessTelecommunications (DECT), or cellular communication technologies, justto mention a few. Cellular communication technologies can include, forexample, code division multiple access-1X (CDMA-1X), Universal MobileTelephone System/High Speed Downlink Packet Access (UMTS/HSDPA), GlobalSystem for Mobile/General Packet Radio System (GSM/GPRS), time divisionmultiple access/Enhanced Data GSM Environment (TDMA/EDGE), EvolutionData Optimized (EV/DO), Worldwide Interoperability for Microwave Access(WiMAX), Software Defined Radio (SDR), Long Term Evolution (LTE), aswell as other next generation wireless communication technologies asthey arise. The wireless transceiver 210 can also be adapted to supportcircuit-switched wireline access technologies (such as Public SwitchedTelephone Network (PSTN)), packet-switched wireline access technologies(such as Transmission Control Protocol/ Internet Protocol (TCP/IP),Voice over Internet Protocol (VoIP), etc.), and combinations thereof.

The processor 202 is communicatively coupled with a user-interface 212.The user interface 212 includes a user output interface 213 and a userinput interface 214.

The user input interface 214 can include a depressible, touch-sensitiveor virtual keypad (or keyboard) with a navigation mechanism such as aroller ball, an optical navigation module (i.e. trackpad), a joystick, amouse, or a navigation disk for manipulating operations of theinformation processing system 200. The keypad can be an integral part ofa housing assembly of the information processing system 200 (e.g., partof a housing for the mobile phone 110 or the laptop PC 108) or anindependent device operably coupled thereto by a tethered wirelineinterface (such as a Universal Serial Bus (USB) cable) or a wirelessinterface supporting, for example, Bluetooth. The keypad can represent anumeric keypad commonly used by phones, and/or a QWERTY keypad withalphanumeric keys. The keypad can also represent a single button orswitch that can invoke function(s) of the information processing system200 upon a activation of the single button or switch.

The user input interface 214 can further include a microphone circuitand associated audio conditioning and processing circuitry such asanalog-to-digital conversion circuits, coupled with the microphonecircuit. The microphone circuit receives audio signals from an ambientenvironment in vicinity of the microphone circuit (e.g., in vicinity ofthe mobile phone 110, the laptop PC 108, and the like), and convertingthe audio signals to electronic audio signals. The analog-to-digitalconversion circuits are operable for converting the electronic audiosignals to digitized audio signals. The microphone circuit andassociated audio conditioning and processing circuitry can be used forreceiving audible signals of a person who is a user of the informationprocessing system 200. According to certain embodiments, the microphonecircuit and associated audio conditioning and processing circuitry canalso be used for voice recognition applications such as to receivevoiced commands and information from a user.

The user input interface 214 can also include an environmental sensorthat can include an accelerometer, a gyroscope, a GPS sensor, aninclinometer, an optical sensor, audio-spectrum sensors, ultrasonictransmitters and sensors, an infrared or other proximity sensor, oranother sensor which can detect orientation or motion. The environmentalsensor can also include a thermometer, a pressure gauge, or otherenvironmental sensor.

The user output interface 213 can include a display such as a monochromeor color Liquid Crystal Display (LCD), Organic Light Emitting Diode(OLED) or other suitable display technology for conveying images to auser of the information processing system 200. In an embodiment wherethe display is touch-sensitive, a portion or all of the keypad can bepresented by way of the display with navigation features.

The display can use touch screen technology to also serve as a userinterface for detecting user input (e.g., touch of a user's finger). Asa touch screen display, the information processing system 200 can beadapted to present a user interface with graphical user interface (GUI)elements that can be selected by a user with a touch of a finger. Thetouch screen display can be equipped with capacitive, resistive or otherforms of sensing technology to detect how much surface area of a user'sfinger has been placed on a portion of the touch screen display. Thissensing information can be used to control the manipulation of the GUIelements. The display can be an integral part of the housing assembly ofthe information processing system 200 or an independent devicecommunicatively coupled thereto by a tethered wireline interface (suchas a cable) or a wireless interface.

The user output interface 213 can further include an audio system thatutilizes audio technology for conveying low volume audio (such as audioheard in proximity of a human ear) and high volume audio (such asspeakerphone for hands free operation). The environmental sensor 113within the UI 104 can also be a charged coupled device (CCD) camera forcapturing still or moving images or for just capturing ambient lightconditions.

The processor 202 is communicatively coupled with a location receiver211 (e.g., a GPS receiver 211 is shown in the example of FIG. 2) whichcan utilize common location technology such as a global positioningsystem (GPS) receiver capable of assisted GPS for identifying a locationof the information processing system 200 (e.g., the mobile phone 110,the laptop PC 108, and the like) based on signals generated by aconstellation of GPS satellites, which can be used for facilitatinglocation services such as navigation and geographic positioning.

In the example of FIG. 2, the processor 202 is communicatively coupledwith short-range communications circuitry 215 which allows the processor202 to communicate with other information processing systems and devicesin the near vicinity of the information processing system 200. Forexample, the short-range communications circuitry 215 may include aninfrared device and associated circuits and components or a RadioFrequency based communication module such as one supporting Bluetooth®communications, to provide for communication with similarly-enabledsystems and devices.

A user-reports repository 216 is communicatively coupled with theprocessor 202. The user-reports repository 216 stores one or more userpulmonary health (e.g., airflow related health) reports associated witheach person who is a user of the information processing system 200. Suchreports can be presented to a user via the user output interface 213, orcan be sent to another system or device such as for presentation toanother person who is a user of the another system or device. Forexample, a report indicating a likelihood of imminent severe airflowrelated health hazard of the person whose airflow related health isbeing analyzed (e.g., the user of the information processing system200), can be immediately displayed to the user (e.g., via the useroutput interface 213) and/or wirelessly sent to another person via atleast one of the wireless transceiver 210 and the short rangecommunications circuitry 215, the sent report being destined forreception by another system or device used by another person. Suchanother person may be, for example and not for limitation, at least oneof a parent, physician, teacher, and a friend, of the person whoseairflow related health is being analyzed, and optionally the anotherperson may be a medical person and/or a first responder such as firerescue personnel. In certain embodiments, the sent report is destinedfor reception by another system or device which is selected at least inpart because they are in the vicinity of the information processingsystem 200.

One or more message packets constituting the report information, as anexample, can be destined for reception by another system or device byadding destination address information (e.g., network destinationidentification information) to the message packets. These messagepackets can be wirelessly transmitted via at least one of the wirelesstransceiver 210 and the short range communications circuitry 215 forreception by the destination another system or device in the vicinity ofthe information processing system 200. In this way, a nearby person maybe able to assist the user of the information processing system 200 whois experiencing an imminent severe airflow related health hazard.However, according to certain embodiments, if a user pulmonary healthreport indicates a non-urgent condition of airflow related healthproblems for the user of the information processing system 200, thenthis type of report could be presented to the user via the user outputinterface 213 (e.g., via the display) to alert the user of thenon-urgent condition.

It should be noted that for the message packets to be wirelesslytransmitted via at least one of the wireless transceiver 210 and theshort range communications circuitry 215 for reception by thedestination another system or device, the address information (e.g.,network destination identification information) may be stored in thenon-volatile memory 206 (such as in the contextual information database226) and retrieved by the processor 202 for generating the messagepackets. Optionally, the address information (e.g., network destinationidentification information) may be maintained in the user pulmonaryhealth tracking database 104 by the corresponding server 102 (see FIG.1). This address information (e.g., network destination identificationinformation) could be periodically sent to the information processingsystem 200, or can be sent in response to receiving a request messagefrom the information processing system 200. In this way, eachinformation processing system 200 in the communication system 100 can becontinuously updated (or updated each time a request-response messagecommunication is established with the server 102), with current addressinformation (e.g., current network destination identificationinformation) of other systems and devices that are in the vicinity ofeach other. This address information is stored in the non-volatilememory 206 and readily available to the processor 202 for notifying withreports and other information the other systems and devices in thecommunication system 100.

In particular, according to various embodiments, the geographic locationof each such system and device in the communication system 100 can betracked by the server 102 and stored in the corresponding database 104.For example, each such system and device can periodically determine itslocation information and sends this location information to the server102, which stores the location information in the corresponding database104. In another example, the NOC 114 can keep track of the locationinformation for each of the wireless devices operating in the wirelesscommunication network N1 112, and periodically send this locationinformation in update messages to the server 102 to maintain the currentlocation information in the corresponding database 104. The server 102can determine whether information processing systems and devices are inthe vicinity of each other, such as by comparing relative locationinformation associated with other systems and devices being tracked inthe corresponding database 104. Thereby, the server 102 can update theaddress information (e.g., network destination identificationinformation) of systems and devices to the other systems and devices inthe vicinity.

An example of a user pulmonary health tracking database 104 is shown inFIG. 3. The user pulmonary health tracking database 104 includes recordsof one or more persons who are users of at least one informationprocessing system 200, such as the mobile phone 110 and the laptop PC108, in the communication system 100 shown in FIG. 1. Each user recordis identified by a user identification code (user ID) 302. The user'srecord is illustrated by a row in the table 104 as shown. Each userrecord includes a user pulmonary health current profile 304, whichcorresponds to the user pulmonary health current profile 220 in theinformation processing system 200 shown in FIG. 2. Each user record alsoincludes a user pulmonary health history 306, which corresponds to theuser pulmonary health history database 222 in the information processingsystem 200 as shown in FIG. 2. Similarly, each user record includes atleast one speech characteristics model 308, which corresponds to theuser's speech characteristics model 224 in the information processingsystem 200 as shown in FIG. 2. Each user record in the user pulmonaryhealth tracking database 104 also includes network identificationinformation 310 for one or more information processing systems 200 thatare used by the user associated with the particular user record. Itshould be noted that, according to various embodiments, the at least onespeech characteristics model 308 may comprise a plurality of speechcharacteristics models 308 corresponding one-to-one with a plurality ofinformation processing systems 200 that are used by the user associatedwith the particular user record. Each user record in the user pulmonaryhealth tracking database 104 also includes contextual information 312which corresponds to the contextual information database 226 in theinformation processing system 200 as shown in FIG. 2. Each user recordin the user pulmonary health tracking database 104 also may includeother data 314 as shown. The other data 314 can include, for example,personal health information for the particular user, emergency contactinformation in case of a medical emergency, and other data that may berelevant to managing the user's pulmonary health, as well as determiningand/or responding to airflow disease trigger events.

An example of a user pulmonary health current profile database 220 isshown in FIG. 4. The user pulmonary health current profile healthdatabase 220 maintains current pulmonary health profile information foreach user of the information processing system 200. The pulmonary healthprofile information may be maintained over a relatively short period oftime, such as hours or days. In the example of FIG. 4, five snapshotsare shown capturing user pulmonary health current profile data for auser. Each row in the table 220 represents one snapshot. Each rowtherefore includes a snapshot identification code (snapshot ID) 402 toidentify the particular snapshot being stored in the user pulmonaryhealth current profile database 220.

Each snapshot also includes time frame (temporal) information 404 whichidentifies temporal information associated with the particular snapshot.Each snapshot includes speech-related characteristics 406 that representthe user's speech-related characteristics associated with the particularsnapshot. It should be noted that the speech-related characteristics 406may include a representation of speech-related characteristicsinformation captured from one or more audio samples of the user's verbalcommunications associated with the particular snapshot. Optionally, thespeech-related characteristics 406 may include a pointer to (or a copyof) the user's speech characteristics model 224 that was applicable toan analysis of the user's pulmonary health based at least on thespeech-related characteristics information captured from the one or moreaudio samples of the user's verbal communications and associated withthe particular snapshot.

Each snapshot also includes location information 408, weather conditionsinformation 410, particulate counts and conditions 412, and othercontextual information 414, associated with the particular snapshot.Additionally, each snapshot includes airflow related episodesinformation 416 for a user, and speaking activities 418 of the user,that are related to the particular snapshot. Each snapshot may alsoinclude other health data 420 of the user that is related to theparticular snapshot. A snapshot therefore represents current pulmonaryhealth profile information for a user of the information processingsystem 200. In certain embodiments, a collection of current snapshots,such as the five snapshots shown in FIG. 4, can be analyzed as a setthat represents current pulmonary health profile information for a user.By using a set of multiple snapshots in the user health profile 220 ananalysis can compensate for transient noise information affecting one(or a few) of the set of snapshots which thereby results in a moreaccurate and robust representation of the user's current pulmonaryhealth profile information.

An example of a user pulmonary health history database 222 is shown inFIG. 5. The user pulmonary health history database 222 contains,according to the present example, snapshots information that could be inthe near term similar to snapshot information maintained in the userpulmonary health current profile database 220. However, the snapshotsinformation collected over a long period of time, such as for days,weeks, months, or for the life of use of an information processingsystem by a user, can include a much richer amount of user healthhistory information.

This user health history information can be mined for identifyingpatterns of information that may be useful for determining trends indata values and for correlations across multiple dimensions (weather,particulate, location, and airflow). Typically this data mining can beperformed off-line, such as during periods of low processing activity ofthe information processing system 200 to help preserve system resources,such as the life of a portable power source (e.g., a battery).

The pulmonary health monitor 218 can use the mined health-related datafor dynamically updating the user's speech characteristics model 224 andoptionally updating the user pulmonary health current profile database220. While the data mining operations can be performed off-line over anextended period of time (e.g., during low processing activity of theinformation processing system 200), the pulmonary health monitor 218typically uses the user's speech characteristics model 224 to analyzeone or more captured audio samples of user data for detecting changes inspeech characteristics at, or near, real-time analysis speeds. Forexample, the analysis of the one or more captured audio samples can beat, or near real-time analysis speeds from the point in time ofobtaining the at least one audio sample. This provides a user, and/orother persons such as medical personnel and other first responders, verytimely information to more quickly manage (and even proactively managebefore an airflow related health episode occurs) any serious airflowhealth situation of the user being monitored by the pulmonary healthmonitor 218.

The user pulmonary health history database 222 includes, for each user,a number of snapshots captured and tracked over an extended period oftime. Each snapshot stored in the database 222 includes a snapshotidentification code (snapshot ID) 502, and a timeframe (temporalinformation) 504 associated with the particular snapshot.

Each snapshot includes speech-related characteristics 506 associatedwith the particular snapshot. It should be noted that the speech-relatedcharacteristics 506 may include a representation of speech-relatedcharacteristics information captured from one or more audio samples ofthe user's verbal communications associated with the particularsnapshot. For example, contours of amplitude change can be extractedfrom the one or more audio samples collected over a period of time. Thecontours of amplitude change can be corresponded to changes in anairflow profile of the person. Optionally, the speech-relatedcharacteristics 506 may include a pointer to (or a copy of) the user'sspeech characteristics model 224 that was applicable to an analysis ofthe user's pulmonary health based at least on the speech-relatedcharacteristics information captured from one or more audio samples ofthe user's verbal communications and associated with the particularsnapshot.

Each snapshot includes location 508, weather conditions information 510,particulate counts and conditions 512, and other contextual information514, associated with the particular snapshot. Additionally, eachsnapshot includes airflow related episodes information 516 for a user,and speaking activities 518 of the user, that are related to theparticular snapshot. Each snapshot may also include other health data520 of the user that is related to the particular snapshot. A snapshotrepresents pulmonary health information for a user of the informationprocessing system 200 at the time of the snapshot. The number ofsnapshots that can be stored in the user pulmonary health historydatabase 222 is limited only by the storage capacity of the non-volatilememory 206.

An example of a user's speech characteristics model 224 is shown in FIG.6. Such user's speech characteristics model 224 would be maintained foreach user of the information processing system 200. The speechcharacteristics model 224, according to the present example, includesuser speech characteristics 602, user personal health data 604, theuser's lung capacity 606, the user's peak air flow information 608,spatial trigger events information 610 associated with the user'spulmonary health and airflow disease triggers, temporal trigger eventsinformation 612 associated with the user's pulmonary health and airflowdisease triggers, and contextual trigger events information 614associated with the user's pulmonary health and airflow diseasetriggers.

Referring to FIG. 7, various functions for an information processingsystem 200 are illustrated according to one example. The informationprocessing system 200, according to the example, operates with new andnovel methods to measure and analyze temporal, spatial, and contextualeffects on lung function of a user of the information processing system200. It should be understood that the information processing system 200may represent any system or device suitable for operating the novelmethods according to the present disclosure, such as at least one of,and not for limitation, the mobile phone 110, the laptop PC 108, aninformation processing system, a smart phone, a tablet computer, andother systems and devices. In the present example will be used a mobilephone 110 merely for discussion purposes and not for limitation. Changesin a user's speech-related characteristics (e.g., speech-relatedcharacteristics representing contours of amplitude change of the user'sspeech-related audio), based on analyzing audio samples of the user'sverbal communications, can be mapped temporally and spatially, and withreference to contextual information, to detect triggers of airflowdisease for the user.

According to the present example, various features and functions in anovel process operating with the information processing system 200(e.g., the mobile phone 110) are outlined below.

1. Record data. (audio, location information, weather and othercontextual information, such as particulate matter).

2. Filter and pre-process data.

3. Analyze the data for applicable speech-related characteristics withreference to the user's speech characteristics model.

4. Where applicable, exchange anonymous data with peers and use it forbuilding and updating the user's speech characteristics model.

5. Mine historical data.

6. Update the user's speech characteristics model based on dynamiccontextual and/or crowd sourced data.

7. Produce one or more reports for a user as a feedback, and optionallyfor other person(s).

A more detailed description of the example process outlined above willnow be discussed. The processor 202, interoperating with the pulmonaryhealth monitor 218, at step 702, records data (e.g., a user'sspeech-related audio, location information, and weather and othercontextual information, such as particulate matter) by collecting andstoring the data in the non-volatile memory 206. The processor 202collects one or more audio samples from an ambient environment in thevicinity of a microphone in the user output interface 213. Sound audioreceived by the microphone is recorded whilst the processor 202determines that a user of the mobile phone 110 is in conversation withothers. This can be done at irregular intervals. Geospatial (e.g.,geographic) location information of the mobile phone 110, at step 704,and weather conditions and other contextual information related to thelocation information, such as particulate matter and pollen countinformation, at step 706, are continuously collected and logged bystoring this information in the user pulmonary health current profiledatabase 220, the history database 222, and the contextual informationdatabase 226. These locally stored information sources (e.g., theprofile database 220, the history database 222, and the contextualinformation database 226) can be queried by the processor 202 to obtaininformation that can be used in analyzing speech-related characteristicsof collected audio data from the user of the information processingsystem 200.

Contextual information such as particulate data and pollen count, etc.,can be downloaded from information source(s) such as the weather andparticulate data server 128 remotely located across the wide areanetwork N2 106. The mobile phone 110 can send request messages (e.g.,send a query message) to the remote server 128 and receive responsemessages therefrom to collect the contextual information. The requestmessages would typically include at least one of: a representation ofthe location information of the person and temporal informationrepresenting substantially a time of obtaining at least one audio sampleof the person's verbal communication. The mobile phone 110 can receivethe response messages that include the additional information requestedby the mobile phone 110.

In certain embodiments, the pulmonary health monitor server 102continuously queries the weather and particulate data server 128 (andpossibly also queries many other servers that provide other contextualinformation) by sending request messages to the remote server 128 andreceiving response messages therefrom to collect the contextualinformation and storing the information in the user pulmonary healthtracking database 104. The mobile phone 110, periodically can send arequest message (e.g., send a query message) to the pulmonary healthmonitor server 102 and receive a response message with a collection ofall the relevant contextual information which the mobile phone 110 canthen store/update in the non-volatile memory 206. The mobile phone 110,according to these embodiments, advantageously is relieved from havingto continuously send many queries (many request messages) and receivemany response messages to-from potentially many different sources ofinformation, e g , many remote servers, to collect the contextualinformation. These many exchanges of request messages and responsemessages by the mobile phone 110, and by many other such informationprocessing systems 200, collectively over a wireless communicationnetwork N1 112 can result in inefficient and reduced communicationthroughput and delayed communication for users of the wirelesscommunication network N1 112. Additionally, the many exchanges ofmessages by the mobile phone 110 over the wireless communication networkN1 112 can be costly and frustrating to the user of the mobile phone 110by incurring additional data charges and operational delays incollecting the contextual information used by the mobile phone 110.

The processor 202 interoperating with the pulmonary health monitor 218,at step 708, filters and pre-processes the collected and stored data.

The sound audio that is recorded whilst the processor 202 determinesthat a user of the mobile phone 110 is in conversation with others, isfiltered and pre-processed to isolate and extract the user's recordedsound audio from other recorded audio (e.g., background audio, noiseaudio, and spoken audio from others in the communication).

It should be noted that, according to various embodiments, the pulmonaryhealth monitor 218 in an information processing system 200, e.g., in themobile phone 110, maintains an inactivity timer with which it tracks aregular time interval during which the user has not been monitored inconversation with others. It is desirable to continuously gather andrecord audio samples of the user's speech audio to accurately profilethe user's speech changes over time. For example, if the user has notbeen making enough phone calls with the mobile phone 110 for up to adefined inactivity time interval, the pulmonary health monitor 218, viathe user interface 212 of the mobile phone 110, can automatically promptthe user to speak any one or more of a defined phrase, one of aplurality of defined phrases, and a randomly selected phrase from aplurality of candidate defined phrases. This would be, for example, somestandard phrase that could be spoken by the user to provide voice sampledata for the analysis engine in the pulmonary health monitor 218. So,for example, if no incidental recordings of the user's voice duringconversation are monitored during some defined time period, theinformation processing system 200 (e.g., mobile phone 110) could perhaps“call” the user (so the phone actually rings, and the user answers thephone), and the user repeats back some defined phrase upon hearing anaudible prompt from the mobile phone 110.

Alternatively, as another example, the mobile phone 110 could notify theuser via the user output interface 213, such as by visual indication ona display, to indicate a recording of the user's voice sample isrequired and, accordingly, displaying a target phrase that the user isrequested to speak into the microphone of the mobile phone 110.According to the example, the user's voice audio would be recorded,processed, and analyzed at the time of obtaining the at least one audiosample from the user's voice audio, and accordingly any significantchanges in the user's speech characteristics would be updated in theuser's speech characteristics model 224 and in the user's health currentprofile database 220. By continuously gathering and recording audiosamples of the user's speech audio the pulmonary health monitor 218 canmore accurately profile the user's speech changes over time.

Audio processing techniques to isolate the user's sound audio from otherrecorded audio are well known to those of ordinary skill in the art.According to various embodiments, for example, the recorded audio thathas been pre-processed by audio signal conditioning circuits (e.g., byfiltering circuits and equalizing circuits) and digitized (e.g., byusing an analog-to-digital converter circuit) is stored in thenon-volatile memory 206. The processor 202 can use digital signalprocessing techniques to further filter and process the digitized audiosignal to isolate the user's sound audio from other recorded audio. Theuser's speech-related characteristics of the recorded user's sound audiocan be processed and stored in non-volatile memory 206. The user's soundaudio may contain non-voiced audio signal that can be filtered for whitenoise and categorized for contextual analysis.

For example, the most common symptoms of asthma include shortness ofbreath, wheezing, chest tightness, and a dry, irritating, continualcough, all caused at least in part by narrowing of the airway thatlimits airflow. Chronic obstructive pulmonary disease, involves agradual progression from inflation to the small airways that limitsairflow to the destruction of alveolar walls and capillaries which leadsto loss of elasticity. Symptoms of emphysema airflow disease include adistinctive cough and shortness of breath. A user's sound audio mayinclude a combination of voiced and non-voiced audio signals that can befiltered for white noise and categorized (e.g., distinctive cough,wheezing, shortness of breath, etc.) for contextual analysis.Particularly the non-voiced audio signals can be categorized such as adistinctive cough, wheezing, and shortness of breath, which can beindicative of the presence of physical airflow disease symptoms.

The processor 202 interoperating with the pulmonary health monitor 218,at step 708, filters and pre-processes the collected and stored weatherand other contextual information such as particulate matter and pollencount, to extract relevant contextual information based on geographiclocation information and temporal information associated with the personwho is the user of the mobile phone 110. While the mobile phone 110 iswith the person who is the user, the mobile phone 110 can be heldstationary or can move with the person following a path along one ormore geospatial (e.g., geographic) regions. The effects of an airflowdisease trigger on the person can occur at any recent point along thepath followed by the person carrying the mobile phone 110. A triggerevent can affect the person's speech and airflow health at substantiallya time of obtaining the at least one audio sample of the person's verbalcommunication. However, an earlier trigger event at a time recentlybefore the time of obtaining the at least one audio sample could alsoaffect the person's speech and airflow health at the time of obtainingthe audio sample. Therefore, the relevant contextual information can befound based on geographic location information and temporal informationfor any recent point along the geographic path being followed by theperson using the mobile phone 110.

A smart mobile phone 110 is capable of connecting to a wide areanetwork, such as the Internet, wherein the mobile phone 110 will be ableto retrieve weather and particulate data associated with the geographicregion the user is located at that point in time, or located at arecently previous point in time. The user geographic location can beobtained by the mobile phone 110 such as through assistance from the GPSreceiver 211 and/or from using the wireless transceiver 210 operating ina wireless communication network N1 112 and utilizing the locationdetermining services and facilities available from the wireless network,such as available using any one or more of cellular networks, Wi-Ficommunication, and/or other geographic location services accessible bythe mobile phone 110. For example, one or more sensors in the mobilephone 110 can detect when in proximity to location identificationdevices in the vicinity of the mobile phone 110. In certain embodiments,at least one of the GPS receiver 211 and the wireless transceiver 210,communicatively coupled with the processor 202, can be used to obtainthe geographic information of the person. This geographic informationcan include a determined geographic location (or a plurality ofgeographic locations) of the person along a path being traveled by theperson up to substantially a time of obtaining the at least one audiosample of the person's verbal communication.

According to the present example, the preprocessing stage, at step 708,involves the quantification of the filtered sound channels (voiced andnon-voiced), the weather data, and the particulate data. These valuesare then used by the processing stage for analysis, as will be discussedbelow.

According to the present example, the processor 202 interoperating withthe pulmonary health monitor 218, at step 710, analyzes the data forapplicable changes in the user's speech-related characteristics in thesampled audio with reference to the user's speech characteristics model224. The processor 202, for example, extracts contours of amplitudechange from the at least one audio sample over a period of time, thecontours of amplitude change corresponding to changes in an airflowprofile of the person. The airflow profile information of the person isstored in at least one of the user's speech characteristics model 224and the user pulmonary health current profile database 220.

Contextual audio data, which can include the level of background noise,and non-voiced data such as coughing and wheezing, could also bedetected. Besides contextual audio data, the geographic location data isanalyzed to augment the accuracy of analysis using the user's speechcharacteristics model 224. The geographic locations that the uservisited in the past, the user's location whilst talking, the prevalenceof particulate matter in those geographic locations, the duration of theperson's stay at the visited geographic locations, the weatherconditions at the times of the visit, and the amount of activity (numberof phone calls, meetings, etc.) the person made during those times, andso forth, are sources of contextual data taken into account whilederiving the changes in the user's speech-related characteristics ascompared to the user's speech characteristics model 224.

Speech-related characteristics from the at least one audio sample willbe recorded including values produced by analyzing such speech-relatedcharacteristics as volume, tempo, intonation, emphasis, sentence andword length, and other speech-related characteristics. Fluctuations insound amplitude, when they happen during a speech, are often associatedwith the effect of any, or a combination, of: dyspynea, sibilantrhonchi, aphasia, or any health issues that affects he person's airflow.In order to quantify this association, the processor 202 interoperateswith the pulmonary health monitor 218 to extract contours of audioamplitude change over a period of time that could be directly mapped tochanges in the airflow profile of a person—after dynamic normalizationof sound volume during the analysis of the one or more audio samples.The processor 202 correlates sound amplitude fluctuation withperiodic/non-periodic episodes related to aforementioned airflow relatedhealth problems. The processor, at step 710, also correlates the soundamplitude fluctuations with contextual data, such as: weather data,particulate data, and user geographic location information.

The processor 202, at step 712, where applicable exchanges anonymouscrowd sourced data with information processing systems and devices ofother persons (e.g., peers of the user of the mobile phone 110). Thisanonymous data can be collected off-line by the mobile phone 110, andused to update the user pulmonary health current profile 220, thehistory database 222, and the user's speech characteristics model 224.Sensing the background contextual data is also managed by exchanginganonymous data with peers when those peers are in vicinity with the userof the mobile phone 110. For instance, other users (via theirinformation processing systems and devices such as their mobile phones110, laptop PCs 108, etc.) could send contextual information ongeographic locations where they have detected airflow disease triggersfor themselves as well as how their condition is trending and/or anyexperiences of acute airflow disease events. The crowd sourcedinformation received by the mobile phone 110 can indicate where atrigger has been detected that detrimentally has affected airflowrelated health of another person at the location of the other personand/or at a location along a path followed by the mobile phone 110 beingcarried by the user of the mobile phone 110.

The processor 202, at step 716, can mine historical data in the userpulmonary health history database 222, and use this information toupdate the user's speech characteristics model 224. Historical data canbe mined for detecting trends, correlations across multiple dimensions(e.g., weather conditions, presence of airborne particulates, geographiclocation, and airflow conditions of the user). The mined data is thenused for dynamically updating the user's speech characteristics model224 that is normally used to analyze the user's collected and storeddata for determining changes in the user's speech-relatedcharacteristics at real-time. Historic data mining, at step 716, can bedone using offline processing such as when the processor 202 is in a lowactivity state, as compared to the analysis of user data, at step 710,for determining changes in speech-related characteristics at, or near,real-time.

The processor 202, at step 714, can use the mined data to update userspeech characteristics model 224. A model of the user's speechcharacteristics 224 is built and updated based on the characteristics ofthe user's speech, how these characteristics relate to pulmonary healthand capacity, and how these characteristics relate to the othercontextual information stored in the non-volatile storage 206, as hasbeen discussed above. This user's speech characteristics model 224 iscreated from user data as well as known constants, and can be used todetermine relative differences in the pulmonary health of the user. Themodel's output may include estimates for lung capacity and peak airflowof the user, spatial information (e.g., geographic location information)associated with the user carrying the mobile phone 110 on their person,temporal information associated with the user using the mobile phone110, and contextual trigger events that are related to the user.

The processor 202, at step 718, can provide feedback by reports that arestored in the user reports repository 216 and provided (e.g., displayed)to the person using the mobile phone 110, and optionally to otherpersons. The results of the continuous analysis, at step 710, is storedlocally in the non-volatile memory 206 and/or sent to the remotepulmonary health monitor server 102 for storage at the correspondinguser pulmonary health tracking database 104.

The user of the mobile phone 110 can be continuously provided, at step718, with the user's performance reports related to their airflowhealth. These reports can include temporal, spatial, geographical, aswell as contextual information that can provide comprehensiveinformation for anyone to identify any potential triggers for airflowrelated diseases and/or existing problems. The reported values in thefeedback are all based on dynamic computation of the user model 224 ascorrelated to changes in the user's speech-related characteristicsassociated with the one or more audio samples collected from the user'sspeech-related audio, and that takes into account the user's contextualand historical data that are stored in the non-volatile storage 206.

The feedback report, while not detecting an urgent health hazardcondition, is provided at regular intervals when there is lesslikelihood of any immediate effect to the user. When the prognosis ismore urgent, indicating a likelihood of severe airflow health hazard tothe user, such as an asthma attack, the feedback report can beinstantaneous. In the latter case, the urgent report could also beshared with the peers (e.g., other information processing systems 200being used by other persons) around the physical geographic vicinity ofthe user, that have been tracked through crowd sourcing of information,at step 712.

In summary, the processor 202 produces an airflow health report, basedat least on the correlating the contours of amplitude change withperiodic episodes typical of airflow related health problems and on thedetermining whether the contours of amplitude change result from atleast one local environmental factor (e.g., an airflow disease trigger)related to the geographic information (e.g., the geographic location ofthe mobile phone 110 at the time of collecting the audio sample from theuser or in the recent past previous to collecting the audio sample).

The report is produced and presented at a regular interval, based on thecorrelating and determining indicating a non-urgent condition of airflowrelated health problems. Alternatively, the report is produced andpresented to the user, based on the correlating and determining, thereport being presented contemporaneously with the correlating anddetermining indicating a likelihood of imminent severe airflow relatedhealth hazard for the user. Additionally, the report can be presented toanother person (e.g., to peers, professional medical personnel, doctors,nurses, emergency rescue personnel, etc.) in the vicinity of the personwhose airflow related health is being analyzed, contemporaneously withthe correlating and determining indicating a likelihood of imminentsevere airflow related health hazard affecting the person.

The presenting, according to various embodiments, can include one ormore of: displaying the report on at least one of: a display of a mobilephone, a display of an information processing system; a display of alaptop personal computer; and a display of a tablet computer.

NON-LIMITING EXAMPLES

As will be appreciated by one skilled in the art, aspects of the presentdisclosure may be embodied as a system, method, or computer programproduct. Accordingly, aspects of the present disclosure may take theform of an entirely hardware embodiment, an entirely software embodiment(including firmware, resident software, micro-code, etc.) or anembodiment combining software and hardware aspects that may allgenerally be referred to herein as a “circuit”,” “module”, or “system.”

Various embodiments of the present invention may be a system, a method,and/or a computer program product. The computer program product mayinclude a computer readable storage medium (or media) having computerreadable program instructions thereon for causing a processor to carryout aspects of the present invention.

The computer readable storage medium can be a tangible device that canretain and store instructions for use by an instruction executiondevice. The computer readable storage medium may be, for example, but isnot limited to, an electronic storage device, a magnetic storage device,an optical storage device, an electromagnetic storage device, asemiconductor storage device, or any suitable combination of theforegoing. A non-exhaustive list of more specific examples of thecomputer readable storage medium includes the following: a portablecomputer diskette, a hard disk, a random access memory (RAM), aread-only memory (ROM), an erasable programmable read-only memory (EPROMor Flash memory), a static random access memory (SRAM), a portablecompact disc read-only memory (CD-ROM), a digital versatile disk (DVD),a memory stick, a floppy disk, a mechanically encoded device such aspunch-cards or raised structures in a groove having instructionsrecorded thereon, and any suitable combination of the foregoing. Acomputer readable storage medium, as used herein, is not to be construedas being transitory signals per se, such as radio waves or other freelypropagating electromagnetic waves, electromagnetic waves propagatingthrough a waveguide or other transmission media (e.g., light pulsespassing through a fiber-optic cable), or electrical signals transmittedthrough a wire.

Computer readable program instructions described herein can bedownloaded to respective computing/processing devices from a computerreadable storage medium or to an external computer or external storagedevice via a network, for example, the Internet, a local area network, awide area network and/or a wireless network. The network may comprisecopper transmission cables, optical transmission fibers, wirelesstransmission, routers, firewalls, switches, gateway computers and/oredge servers. A network adapter card or network interface in eachcomputing/processing device receives computer readable programinstructions from the network and forwards the computer readable programinstructions for storage in a computer readable storage medium withinthe respective computing/processing device.

Computer readable program instructions for carrying out operations ofthe present invention may be assembler instructions,instruction-set-architecture (ISA) instructions, machine instructions,machine dependent instructions, microcode, firmware instructions,state-setting data, or either source code or object code written in anycombination of one or more programming languages, including an objectoriented programming language such as Java, Smalltalk, C++ or the like,and conventional procedural programming languages, such as the “C”programming language or similar programming languages. The computerreadable program instructions may execute entirely on the user'scomputer, partly on the user's computer, as a stand-alone softwarepackage, partly on the user's computer and partly on a remote computeror entirely on the remote computer or server. In the latter scenario,the remote computer may be connected to the user's computer through anytype of network, including a local area network (LAN) or a wide areanetwork (WAN), or the connection may be made to an external computer(for example, through the Internet using an Internet Service Provider).In some embodiments, electronic circuitry including, for example,programmable logic circuitry, field-programmable gate arrays (FPGA), orprogrammable logic arrays (PLA) may execute the computer readableprogram instructions by utilizing state information of the computerreadable program instructions to personalize the electronic circuitry,in order to perform aspects of the present invention.

Aspects of the present disclosure are described herein with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems), and computer program products according to embodiments of theinvention. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer readable program instructions.

These computer readable program instructions may be provided to aprocessor of a general purpose computer, special purpose computer, orother programmable data processing apparatus to produce a machine, suchthat the instructions, which execute via the processor of the computeror other programmable data processing apparatus, create means forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks. These computer readable program instructionsmay also be stored in a computer readable storage medium that can directa computer, a programmable data processing apparatus, and/or otherdevices to function in a particular manner, such that the computerreadable storage medium having instructions stored therein comprises anarticle of manufacture including instructions which implement aspects ofthe function/act specified in the flowchart and/or block diagram blockor blocks.

The computer readable program instructions may also be loaded onto acomputer, other programmable data processing apparatus, or other deviceto cause a series of operational steps to be performed on the computer,other programmable apparatus or other device to produce a computerimplemented process, such that the instructions which execute on thecomputer, other programmable apparatus, or other device implement thefunctions/acts specified in the flowchart and/or block diagram block orblocks.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof instructions, which comprises one or more executable instructions forimplementing the specified logical function(s). In some alternativeimplementations, the functions noted in the block may occur out of theorder noted in the figures. For example, two blocks shown in successionmay, in fact, be executed substantially concurrently, or the blocks maysometimes be executed in the reverse order, depending upon thefunctionality involved. It will also be noted that each block of theblock diagrams and/or flowchart illustration, and combinations of blocksin the block diagrams and/or flowchart illustration, can be implementedby special purpose hardware-based systems that perform the specifiedfunctions or acts or carry out combinations of special purpose hardwareand computer instructions.

While the computer readable storage medium is shown in an exampleembodiment to be a single medium, the term “computer readable storagemedium” should be taken to include a single medium or multiple media(e.g., a centralized or distributed database, and/or associated cachesand servers) that store the one or more sets of instructions. The term“computer-readable storage medium” shall also be taken to include anynon-transitory medium that is capable of storing or encoding a set ofinstructions for execution by the machine and that cause the machine toperform any one or more of the methods of the subject disclosure.

The term “computer-readable storage medium” shall accordingly be takento include, but not be limited to: solid-state memories such as a memorycard or other package that houses one or more read-only (non-volatile)memories, random access memories, or other re-writable (volatile)memories, a magneto-optical or optical medium such as a disk or tape, orother tangible media which can be used to store information.Accordingly, the disclosure is considered to include any one or more ofa computer-readable storage medium, as listed herein and includingart-recognized equivalents and successor media, in which the softwareimplementations herein are stored.

Although the present specification may describe components and functionsimplemented in the embodiments with reference to particular standardsand protocols, the disclosure is not limited to such standards andprotocols. Each of the standards represents examples of the state of theart. Such standards are from time-to-time superseded by faster or moreefficient equivalents having essentially the same functions.

The illustrations of examples described herein are intended to provide ageneral understanding of the structure of various embodiments, and theyare not intended to serve as a complete description of all the elementsand features of apparatus and systems that might make use of thestructures described herein. Many other embodiments will be apparent tothose of skill in the art upon reviewing the above description. Otherembodiments may be utilized and derived therefrom, such that structuraland logical substitutions and changes may be made without departing fromthe scope of this disclosure. Figures are also merely representationaland may not be drawn to scale. Certain proportions thereof may beexaggerated, while others may be minimized. Accordingly, thespecification and drawings are to be regarded in an illustrative ratherthan a restrictive sense.

Although specific embodiments have been illustrated and describedherein, it should be appreciated that any arrangement calculated toachieve the same purpose may be substituted for the specific embodimentsshown. The examples herein are intended to cover any and all adaptationsor variations of various embodiments. Combinations of the aboveembodiments, and other embodiments not specifically described herein,are contemplated herein.

The Abstract is provided with the understanding that it is not intendedbe used to interpret or limit the scope or meaning of the claims. Inaddition, in the foregoing Detailed Description, various features aregrouped together in a single embodiment for the purpose of streamliningthe disclosure. This method of disclosure is not to be interpreted asreflecting an intention that the claimed embodiments require morefeatures than are expressly recited in each claim. Rather, as thefollowing claims reflect, inventive subject matter lies in less than allfeatures of a single disclosed embodiment. Thus the following claims arehereby incorporated into the Detailed Description, with each claimstanding on its own as a separately claimed subject matter.

Although only one processor 202 is illustrated for informationprocessing system 200, information processing systems with multiple CPUsor processors can be used equally effectively. Various embodiments ofthe present disclosure can further incorporate interfaces that eachincludes separate, fully programmed microprocessors that are used tooff-load processing from the processor 202. An operating system (notshown) included in main memory for the information processing system 200may be a suitable multitasking and/or multiprocessing operating system,such as, but not limited to, any of the Linux, UNIX, Windows, andWindows Server based operating systems. Various embodiments of thepresent disclosure are able to use any other suitable operating system.Some embodiments of the present disclosure utilize architectures, suchas an object oriented framework mechanism, that allows instructions ofthe components of operating system (not shown) to be executed on anyprocessor located within the information processing system. Variousembodiments of the present disclosure are able to be adapted to workwith any data communications connections including present day analogand/or digital techniques or via a future networking mechanism.

The terminology used herein is for the purpose of describing particularembodiments only and is not intended to be limiting of the invention. Asused herein, the singular forms “a”, “an” and “the” are intended toinclude the plural forms as well, unless the context clearly indicatesotherwise. It will be further understood that the terms “comprises”and/or “comprising,” when used in this specification, specify thepresence of stated features, integers, steps, operations, elements,and/or components, but do not preclude the presence or addition of oneor more other features, integers, steps, operations, elements,components, and/or groups thereof. The term “another”, as used herein,is defined as at least a second or more. The terms “including” and“having,” as used herein, are defined as comprising (i.e., openlanguage). The term “coupled,” as used herein, is defined as“connected,” although not necessarily directly, and not necessarilymechanically. “Communicatively coupled” refers to coupling of componentssuch that these components are able to communicate with one anotherthrough, for example, wired, wireless or other communications media. Theterm “communicatively coupled” or “communicatively coupling” includes,but is not limited to, communicating electronic control signals by whichone element may direct or control another. The term “configured to”describes hardware, software or a combination of hardware and softwarethat is adapted to, set up, arranged, built, composed, constructed,designed or that has any combination of these characteristics to carryout a given function. The term “adapted to” describes hardware, softwareor a combination of hardware and software that is capable of, able toaccommodate, to make, or that is suitable to carry out a given function.

The terms “controller”, “computer”, “processor”, “server”, “client”,“computer system”, “computing system”, “personal computing system”,“processing system”, or “information processing system”, describeexamples of a suitably configured processing system adapted to implementone or more embodiments herein. Any suitably configured processingsystem is similarly able to be used by embodiments herein, for exampleand not for limitation, a personal computer, a laptop personal computer(laptop PC), a tablet computer, a smart phone, a mobile phone, awireless communication device, a personal digital assistant, aworkstation, and the like. A processing system may include one or moreprocessing systems or processors. A processing system can be realized ina centralized fashion in one processing system or in a distributedfashion where different elements are spread across severalinterconnected processing systems.

The term “geographic information” means any one or more of “geographiclocation information”, “temporal information”, and a combination of bothspace and time information such as “a geospatial location atsubstantially a point in time”, “a geographic location at substantiallya point in time”, “one or more geospatial locations within a timeinterval”, and “one or more geographic locations within a timeinterval”, and the like. As an example, and not for limitation, use ofthe term geographic information may include “at this time of the year ageographic location of the person whose airflow health is beingmonitored”.

The corresponding structures, materials, acts, and equivalents of allmeans or step plus function elements in the claims below are intended toinclude any structure, material, or act for performing the function incombination with other claimed elements as specifically claimed. Thedescription herein has been presented for purposes of illustration anddescription, but is not intended to be exhaustive or limited to theexamples in the form disclosed. Many modifications and variations willbe apparent to those of ordinary skill in the art without departing fromthe scope of the examples presented or claimed. The disclosedembodiments were chosen and described in order to explain the principlesof the embodiments and the practical application, and to enable othersof ordinary skill in the art to understand the various embodiments withvarious modifications as are suited to the particular use contemplated.It is intended that the appended claims below cover any and all suchapplications, modifications, and variations within the scope of theembodiments.

1-10. (canceled)
 11. An information processing system capable ofanalyzing airflow related health of a person, the information processingsystem comprising: a microphone circuit for receiving audio signals froman ambient environment in vicinity of the information processing system,and converting the audio signals to electronic audio signals;analog-to-digital conversion circuits, coupled with the microphonecircuit, for converting the electronic audio signals to digitized audiosignals; memory; non-volatile memory for storing data and computerinstructions; a pulmonary health monitor, communicatively coupled withthe non-volatile memory; a user pulmonary health current profile,communicatively coupled with the non-volatile memory; a user's speechcharacteristics model, communicatively coupled with the non-volatilememory; a contextual information database, communicatively coupled withthe non-volatile memory; a processor, communicatively coupled with theanalog-to-digital conversion circuits, the memory, the non-volatilememory, and the pulmonary health monitor, and wherein the processor,responsive to executing computer instructions, performs operationscomprising: obtaining at least one audio sample of a person's verbalcommunication, captured from the ambient environment in vicinity of theinformation processing system; obtaining geographic information of theperson, the geographic information being associated with the at leastone audio sample of the person's verbal communication; querying at leastthe contextual information database based on the geographic information,and as a result of the querying obtaining additional information fromthe contextual information database, the additional information beingrelated to the geographic information; extracting contours of amplitudechange from the at least one audio sample over a period of time, thecontours of amplitude change corresponding to changes in an airflowprofile of the person, the airflow profile of the person being stored inat least one of the user's speech characteristics model and the userpulmonary health current profile; correlating the contours of amplitudechange with periodic episodes typical of airflow related healthproblems; and determining, based at least on the additional information,whether the contours of amplitude change result from at least one localenvironmental factor related to the geographic information.
 12. Theinformation processing system of claim 11, further comprising a useroutput interface communicatively coupled with the processor, and whereinthe processor, responsive to executing computer instructions, performsoperations comprising: producing a report, based at least on thecorrelating and on the determining, of the airflow related health of theperson; and presenting the report via the user output interface.
 13. Theinformation processing system of claim 12, wherein the user outputinterface comprises a display, and wherein the presenting comprisesdisplaying the report on the display of the information processingsystem.
 14. The information processing system of claim 12, wherein thedetermining is at, or near real-time analysis speeds from the obtainingof the at least one audio sample, and wherein the presenting comprisesat least one of: presenting the report at a regular interval, based onthe correlating and determining indicating a non-urgent condition ofairflow related health problems; and presenting, based on thecorrelating and determining, the report contemporaneously with thecorrelating and determining indicating a likelihood of imminent severeairflow related health hazard.
 15. The information processing system ofclaim 11, further comprising at least one of a wireless transceiver andshort range communications circuitry, communicatively coupled with theprocessor, and wherein the processor, responsive to executing computerinstructions, performs operations comprising: producing a report, basedat least on the correlating and on the determining, of the airflowrelated health of the person; and wirelessly sending the report via theat least one of the wireless transceiver and the short rangecommunications circuitry, destined for reception by a second informationprocessing system in the vicinity of the information processing system,based on the correlating and determining indicating a likelihood ofimminent severe airflow related health hazard of the person whoseairflow related health is being analyzed.
 16. The information processingsystem of claim 15, further comprising a user output interfacecommunicatively coupled with the processor, wherein the determining isat, or near real-time analysis speeds from the obtaining of the at leastone audio sample, and wherein the processor, responsive to executingcomputer instructions, performs operations comprising: presenting, basedon the correlating and determining, the report via the user outputinterface contemporaneously with the correlating and determiningindicating a likelihood of imminent severe airflow related health hazardof the person whose airflow related health is being analyzed.
 17. Theinformation processing system of claim 11, further comprising at leastone of a GPS receiver and a wireless transceiver, communicativelycoupled with the processor, and wherein the obtaining the geographicinformation of the person comprises determining, using the at least oneof a GPS receiver and a wireless transceiver, a geographic location ofthe person along a path being traveled by the person up to substantiallya time of obtaining the at least one audio sample of the person's verbalcommunication.
 18. The information processing system of claim 17,wherein the processor, responsive to executing computer instructions,performs operations comprising: wirelessly sending, using the wirelesstransceiver, a request message to a remote server, the request messageincluding at least one of: a representation of the geographic locationinformation of the person; and temporal information associated withsubstantially a time of obtaining the at least one audio sample of theperson's verbal communication; and wherein the obtaining additionalinformation comprises: receiving a response message from the remoteserver, the response message including the additional information.
 19. Acomputer readable storage medium, comprising computer instructionswhich, responsive to being executed by a processor, cause the processorto perform operations comprising: obtaining at least one audio sample ofa person's verbal communication; obtaining geographic information of theperson, the geographic information being associated with the at leastone audio sample of the person's verbal communication; querying at leastone additional source of information based on the geographicinformation, and as a result of the querying obtaining additionalinformation from the at least one additional source of information, theadditional information being related to the geographic information; fromthe at least one audio sample, extracting contours of amplitude changeover a period of time that can be mapped to changes in an airflowprofile of the person; correlating the contours of amplitude change withperiodic episodes typical of airflow related health problems; anddetermining, at, or near real-time analysis speeds from the obtaining ofthe at least one audio sample and based at least on the additionalinformation, whether the contours of amplitude change result from atleast one local environmental factor related to the geographicinformation.
 20. The computer readable storage medium of claim 19,further comprising: producing a report, based at least on thecorrelating and on the determining, of the airflow related health of theperson; and displaying the report on at least one of: a display of amobile phone; a display of an information processing system; a displayof a laptop personal computer; and a display of a tablet computer.